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' Abstract 

P-i- 

' Is the geometry of space a macroscopic manifestation of an underly- 

' ing microscopic statistical structure? Is geometrodynamics - the theory 

of gravity - derivable from general principles for processing information? 
Tentative answers are suggested by a model of geometrodynamics based 
\ on the statistical concepts of entropy, the Fisher-Rao information metric, 

^ ■ and entropic dynamics. The model shows remarkable similarities with the 

QO ' 3+1 formulation of general relativity. For example, the dynamical degrees 

, of freedom are those that specify the conformal geometry of space; there 

is a gauge symmetry under 3d diffeomorphisms; there is no reference to 
00 ■ an external time; and the theory is time reversible. There is, in adition, 

, a gauge symmetry under scale transformations. I conjecture that under a 

suitable choice of gauge one can recover the usual notion of a relativistic 
space-time. 

o 
^• 

}Lt '. 1 Statistical Geometrodynamics? 
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The point of view that has been prevalent among scientists is that the laws 
of physics mirror the laws of nature. The reflection might be imperfect, a 
mere approximation to the real thing, but it is a reflection nonetheless. The 
^ . connection between physics and nature could, however, be less direct. The laws 

of physics could be mere rules for processing information about nature. If this 
second point of view turns out to be correct one would expect many aspects 
of physics to mirror the structure of theories of inference. Indeed, it should 
be possible to derive the "laws of physics" appropriate to a certain problem 
by applying standard rules of inference to the information that happens to be 
relevant to the problem at hand.^ 

There is strong evidence that this second point of view is worth pursuing. For 
example, most of the formal structure of statistical mechanics can be explained 
as a consequence of the method of maximum entropy A second example 

'Presented at MaxEnt 2005, the 25th International Workshop on Bayesian Inference and 
Maximum Entropy Methods (August 7-12, 2005, San Jose, California, USA). 

^ Basic requirements of consistency, objectivity, universality, and honesty lead to the theory 
of probabihty and to the method of maximum entropy ^^'^ uniquely natural 

rules of inference. 
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is given by quantum mechanics. It is less well-known but nevertheless still 
true that many features of the quantum formalism that are usually introduced 
as postulates (the Hilbert spaces, linear and unitary time evolution, the Born 
probability rule, Hermitian observables, etc.) can be derived from principles of 
inference (consistency, entropy, and so on) once the subject matter has been 
correctly identified [7]. 

This paper explores the possibility that the general theory of relativity is 
also a theory of this type; that it can be derived from an underlying "statis- 
tical geometrodynamics" in much the same way that thermodynamics can be 
explained from an underlying statistical mechanics. 

Our subject can be approached from a different direction. Modern develop- 
ments in statistical inference have shown that geometrical concepts turn 
out to be extremely natural tools to manipulate information. If physics is noth- 
ing but manipulating information about the world, then this suggests an expla- 
nation for the central role that geometry has always played in physics. It also 
suggests that it should be possible to explain basic geometrical notions such as 
spatial distance and temporal duration in terms of even more basic statistical 
notions. 

In section 2 we take the first step towards specifying the subject matter. 
(The statistical geometrodynamics developed here is a model for empty vac- 
uum; it does not include matter.) The difficulty is that space and time are 
invisible. What we see is not space but matter in space and it is not clear 
how to disentangle which properties should be attributed to matter and which 
to space. The best one can do is sprinkle space with ideal test particles that 
are neutral to all interactions and are describable by a minimal number of at- 
tributes. Such purest form of matter is a dust of identical particles; they only 
interact gravitationally, and being identical the only attribute that distinguishes 
them is their position. 

Then we introduce the main assumption: there is an intrinsic fuzziness to 
space which is revealed by an irreducible uncertainty in the location of the test 
particles. Thus, to each point in space we associate a probability distribution. 
The overall state of space - the macrostate - is defined by the product of the 
distributions associated to the individual points. The geometry of space is the 
geometry of all the distances between test particles and this geometry is of 
statistical origin ^01 • Identical particles that are close together are easy to con- 
fuse, those that are far apart are easy to distinguish. The distance between 
two neighboring particles is the distinguishability distance between the corre- 
sponding probability distributions which is given by the Fisher- Rao metric jll) . 
A remarkable feature of this choice of distance is its uniqueness: the Fisher- 
Rao metric is the only metric that takes account of the fact that we deal with 
probability distributions and not with "structureless" points A second re- 
markable feature is that the information geometry we introduce does not define 
the full Riemannian geometry of space but only its conformal geometry. This 
appears at first to be a threat to the whole program but it turns to be just what 
we need in a theory of gravity . 

But the task of specifying the subject matter is not yet finished. A proper 
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understanding of what we mean by a state requires that we be able to quantify 
the extent to which one state can be distinguished from another. In particular, 
the measure of time and dynamics itself derive from our capacity to measure 
change between one state that we call 'earlier' and another state that we call 
'later' ^1]. In section 3 we measure the change from one state to another using, 
once again, the Fisher-Rao metric. A peculiarity that arises when comparing the 
states of systems with a continuum of degrees of freedom turns out to be very 
significant. In such cases we have to make an explicit choice about which location 
in the later state corresponds, matches, or ultimately, is the same as a given 
location in the earlier state. The method of maximum entropy provides a natural 
criterion to achieve the best match between two successive states^ . The resulting 
best-matching condition closely resembles the diffeomorphism constraint in the 
Hamiltonian formulation of general relativity |16| . 

It is interesting that the Fisher-Rao metric is used in two ways that are 
conceptually very different. One is to distinguish neighboring points, the other 
to distinguish successive states. The first is related to spatial distance, the 
second to temporal duration. This suggests an explanation of the old puzzle 
of how can space and time be so different physically and yet be represented 
mathematically in such a symmetrical way. 

Having specified the states, in section 4 we tackle the dynamics. We ask: 
Given the initial and the final states, what trajectory is the system expected 
to follow? In the usual approach the dynamics is postulated. No further ex- 
planation is needed because "that's the way nature is." But this route is not 
open to us. We are just making inferences from relevant information and the 
expected trajectory is obtained, without additional postulates, from a principle 
of inference: the method of maximum entropy jl()j|17j . 

The resulting entropic dynamics is not identical with the general theory 
of relativity but there are remarkable similarities which strongly suggest that 
general relativity can be obtained in some appropriate limit. 

2 The information geometry of space 

Consider a cloud of identical test particles - specks of dust - suspended in an 
otherwise empty space. There are no rulers and no clocks, just dust. Being 
identical the particles are easy to confuse. The only distinction between two of 
them is that one happens to be here while the other is over there. To distinguish 
one speck of dust from another we assign labels or coordinates to each particle. 
We assume that three real numbers {y^,y'^,y^) are sufficient. 

But particles can be mislabeled. Then the "true" coordinates y are unknown 
and one can only provide an estimate, x. Let p(y\x)dy be the probability that 
the particle labeled x should have been labeled y. The labels x are introduced 
to distinguish one particle from another, but can we distinguish a particle at 

■^To borrow a term coined by Barbour, we might say that best-matching estabUshes a 
relation of "equilocahty" 1151 . 
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X from another at a: + dxl If dx is small enough the corresponding probabil- 
ity distributions p{y\x) and p{y\x + dx) overlap considerably and it is easy to 
confuse them. We seek a quantitative measure of the extent to which these two 
distributions can be distinguished. 

The following crude argument is intuitively appealing. Consider the relative 
difference, 

p{y\x + dx) -p{y\x) ^ d\ogp{y\x) 

p{y\x) dx^ ' 

where we adopt Einstein's convention of summing over the repeated indices. 
The expected value of this relative difference does not provide us with the de- 
sired measure of distinguishability because it vanishes identically. However, the 
variance 

dX^ ^ J d^piy\x) ^l^^g^ ^^^f^ dx^dx^ ix)dx^dx^ . (2) 

is positive definite - it vanishes if and only if dx'' — 0. This is the measure 
of distinguishability we seek. Except for an overall multiplicative constant, the 
Fisher-Rao metric 7^ is the only Rieniannian metric that adequately reflects 
the underlying statistical nature of the manifold of distributions p{y\x) |12| . 
An important property that will be exploited below is the relation between the 
metric ^ and the entropy of p(i/\x + dx) relative to p{y\x), 

S[p{y\x + dx)\p{y\x)] = - J d^y p{y\x + dx) log ^^y^;^^ = -^dX\ (3) 

Thus, maximizing the relative entropy S is equivalent to minimizing the distance 
dX^. 

We take the further step of interpreting dX as the spatial distance. Indeed, 
one would normally say that the reason it is easy to confuse two particles is 
that they happen to be too close together. We argue in the opposite direction 
and explain that the reason the particles at x and at x + dx are close together 
is because they arc difhcult to distinguish. 

The origin of the uncertainty is left unspecified. We assume, however, that 
any two particles at the same location in space are affected by the same irre- 
ducible uncertainty. Then the uncertainty is not linked to the particle, but to 
the place: the source of the uncertainty is a noise, a fluctuation or a fuzziness 
in space itself. 

To assign an explicit p{y\x) we consider what is perhaps the simplest possibil- 
ity. We assume that p{y\x) is sharply localized in a small neighborhood about x 
and that within this very small region curvature effects can be neglected. We fur- 
ther assume that the information that is relevant to our problem is given by the 
expected values (y') — 2;* and the covariance matrix {{y''—x''){y^—x^)) — C"-' (a:). 
This is physically reasonable: for each test particle we have estimates of its po- 
sition and of a small margin of error. Since the underlying space is locally flat, 
p{y\x) can be determined maximizing entropy relative to a uniform measure. 
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This leads to a Gaussian distribution, 



r 1 ... 



) 



(4) 



where is the inverse of the covariance matrix C*-' , C'^'^Ci 



= (5}, and C = 



det Cij . The corresponding metric is obtained from eq. ^ . For small uncertain- 
ties Cij{x) is constant within the region where p{y\x) is appreciable and we get 
lij (^) — ^ij (2^) • The metric changes smoothly over space and, in general, space 
is curved. Connections, curvatures, and other aspects of the geometry can be 
computed in the standard way. 

To summarize, to each point x in space we associate a probability distribu- 
tion, 



and considerations of distinguishability among points (as revealed by appro- 
priate test particles) lead us to introduce the metric field 7^ (2;). The idea is 
general but was developed explicitly only for the special case of small uncer- 
tainties, that is, for test particles that are localized within regions much smaller 
than those where curvature effects become appreciable. Situations of extreme 
curvature found near singularities will not be considered here. 

But there is a feature of the distinguishability distance d\ in ^ that is very 
significant: it is dimensionless. Indeed, in eq.© we can see that the metric 
Jijix) measures spatial lengths in units of the local uncertainty: if the local 
uncertainty is cr(x), then the actual Riemannian metric is gij{x) = u'^{x)^ij{x) 
. This immediately raises the question of how to compare the uncertainties cr{x) 
at two separate points. Information geometry only allows one to compare the 
lengths of small segments at the same place; it allows one to measure angles; 
it does not describe the full geometry of space; it only describes its conformal 
geometry. To assign a geometry to space we need to introduce an additional 
scalar field a{x). 

One possibility, which we pursue in the rest of this paper, is that only 
describes the conformal geometry of space and that this is all we really need. 
(Entropic dynamics is defined on a space of probability distributions, no ad- 
ditional structure is needed.) Perhaps the answer to the question of how to 
compare uncertainties at two different locations is: Why would we care? It is 
not that the irreducible uncertainty a{x) varies from point to point; perhaps 
such a comparison is objectively meaningless and therefore unnecessary. How 
can we define the length of an extended curve? Or, how can we compare distant 
lengths? We cannot. For most practical purposes this does not matter because 
usually we are only concerned with local distances and information geometry is 
quite adequate for this restricted purpose. 

But if we strongly feel that we must compare distant lengths as a tool for 
reasoning, if we feel that we must define the length of curves for the sole purpose 
of constructing images and pictures in order to visualize the universe, then to 



p{y\x,j) 




(5) 
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satisfy this merely psychological urge, we can introduce a field a{x). In this 
case our predictions should not depend on the particular choice of a{x) which, 
being arbitrary, might as well be chosen to make our models convenient and 
simple. The selection of cr{x) should be guided by purely esthetic considerations: 
distance should be defined so that motion looks simple. 

3 Change 

We define the macrostate of space as a product over individual space points,^ 

P[{y}h] = Upiy\^,^) ■ (6) 

X 

To quantify the change from one state to another we use, once again, the Fisher- 
Rao metric, but a complication arises here. The comparison between two neigh- 
boring product states I7] and -?[{?/} I7+ A7] is carried out by comparing 
the individual factors and we need an explicit criterion to match factors in one 
state with factors in the other. For each position x in one state we must decide 
which is the matching x' in the other state. We must establish a relation of "equi- 
locality" . Let us provisionally assume that a best-matching criterion has been 
found and that equilocal points have been assigned the same (or "commoving" ) 
coordinates. Later we return to the question of specifying the "best-matching" 
criterion. 

Since the state Q is a product, the change from ^'[{y}|7] to P[{y}\j + A7] 
is a sum where the contributions of the different degrees of freedom add in 
quadrature, 

AL^ ^J:A£^{x) , (7) 

where A£^(x) measures the change from p (?/|a;, 7) to its equilocal counterpart 
p {y\x, 7 -I- A7) . For each position x, we have 



A^2(^)^G'^.fe^A7,,A7,, , (8) 



where, using eq.JSJ), 



= lifl^'+Y'l'") ■ (9) 

We can write the sum in eq.Q as an integral if we note that the density of 
distinguishable distributions is 7-'^/^. In other words, the number of distinguish- 
able distributions, or "distinguishable points" , within the coordinate interval dx 

There is an assumption here that we do not need to keep track of information about 
correlations among degrees of freedom at different locations. Information about correlations 
may eventually turn out to be relevant (perhaps to account for non-gravitational interactions) 
and could be included in more elaborate statistical models of geometrodynamics. 
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is dx^^l"^ (dx stands for (i^x).^ Then iQ is replaced by 

AL^ =\dx^^l^Ae = /dx7^/'G'^'='A7,,A7,, . (10) 

Two points in space count as separate only to the extent that they can be distin- 
guished. The effective number of spatial degrees of freedom, that is the number 
of "distinguishable points" in the coordinate interval dx is finite. This is nei- 
ther due to an underlying discreteness in the structure of space nor to quantum 
effects, but due to the underlying intrinsic fuzziness of space. 

To describe the change A7y (x) at each location x it is convenient to intro- 
duce an arbitrary "time" parameter t along the trajectory, 

^1^J = 1^J (t + At, X) ~ 7y. {t, X) = dtl,, At , (11) 

9t7y is the "velocity" of the metric in the special best-matched frame. Then 
ea. lfTn|) becomes 

AL^ ^ J dx-f^/^G'^ ''^da.jdakAt^ ■ (12) 

Having computed the change in the special commoving frame where equilocal 
points have the same coordinates we now switch to an arbitrary coordinate frame 
where equilocal points at t and t + At have coordinates a;' and a;* = — /3*(a;) At 
respectively; equilocal points are "shifted" by (3^ At. Under the infinitesimal shift 
= — /3*(x)At the metric at i -I- At transforms into 7^^ , 

7,^. {t + At, x) = 7,^. {t + At, x) - ( V,/3^- + V,/3,;) At , (13) 

where Vi/3j — diPj — r^^/?^ is the covariant derivative associated to the metric 
7j^-. In the new frame, setting 7^ (t + At, a;) — ^^(t,x) = A7j^, the change in 
7jj between equilocal points is expressed as 

A;57,^. = A7,^. - (V,/3^. + V,/3,) At , (14) 
or, A^7ij = 7yAt, where 

= - V,/3, - . (15) 

In terms of the transformed coordinates the change Al? retains the same form 
as before, ea. H12|) . except that the new best-matched velocities 7^ are the co- 
ordinate velocities dt^^ suitably "corrected" by the shift 

A^,L2=/da:7^/'G^^'='7.,7fc,At2. (16) 

Note that AL? depends only on the initial and final states and is invariant under 
the reparametrization of time t — > t' = /(t, x). 

^Note that since we cannot compare distant lengths or distant volumes it makes no sense 
to say that dx^^l"^ measures the volume of an extended region 7?.; it measures the number 
of distinguishable points in 7^. 
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Now we address the problem of specifying the best-matching criterion. For 
given velocities 9(7^ our estimate A^L^ of the actual change AL^ can be ar- 
tificially altered by different choices of the shift We have to decide which 
values of /3* provide the best equilocality match. 

The problem of selecting the optimal shift can be tackled as a problem of 
inference: the "prior" state of information is described by the earlier distribution 
Pt — P[{y}\l\, and we are given the new information that the "posterior" state 
belongs to the later "trial" family of distributions Pt+At — P[{y}\l + A7]. 
The trial distributions are essentially identical except for diffeomorphisms - the 
spatial shifts P^At. Which one do we choose? We choose the distribution that 
does the least violence to our prior beliefs while fully accommodating the new 
information. Phrased in this way it is clear that this is the kind of question the 
method of maximum entropy was designed to answer: Best matching reflects 
the least change. 

The actual change AL^ between the two successive states is obtained [us- 
ing the property in eq.®] either by maximizing the appropriate relative en- 
tropy S[Pt+At\Pt] or by minimizing the corresponding ApL? , S[Pt+At\Pt\ = 
— A/3i^/2, over all choices of /3\ 

AL^ = min AgL^ . (17) 

Vary with respect to (3, 

5 (AgL^) = 2 J dx7^/'G*^'^'7./7fci At'^0. (18) 

Next use ^7^.; = —VkS/3i — V;5/3j. and integrate by parts to get 

Vi{2G'^'''%) =0 or Vz7^'=0, (19) 
where we used eq.© and 

Eas. (|19|l are the differential equations that determine the shift /3* that es- 
tablishes the best matching and equilocality between the given initial and final 
geometries 7,^ and 7^ -I- Aj^^^. Alternatively, we can consider these equations 
as constraints on the allowed change A7j^ = dtj^jAt for a given shift /3*. 

4 Entropic dynamics 

The dynamical question is "Given initial and final states, what trajectory is 
the system expected to follow?" The answer ^OlCZl follows from the implicit 
assumption that there exists a continuous trajectory. This reduces the problem 
of studying large changes to the simpler problem of studying small changes. 

Consider the short segment of the trajectory between the states Pt and 
Pt+At- The idea is that in going from one to the other the system must pass 
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through a halfway point, and also through a state that lies a third of the way, 
and so on. More generally, the trajectory is composed of states such that having 
travelled a distance dL from the initial Pt , there remains a distance LodL to the 
final Pt+At, with < a; < cxd. The trajectory is the set of states obtained as w 
sweeps from to oo. 

However, in the case of geometrodynamics we know much more than just 
that the product state eq.® must evolve through a continuous sequence of 
intermediate states. We also know that each and every one of the individual 
factors must evolve continuously through a sequence of intermediate states to 
reach the corresponding final state. This means that instead of one parameter 
CO there are many such parameters, one for each position x. In other words, the 
intermediate states Pi^ interpolating between the initial Pt and the final Pt+At 
should be labeled by a function u!{x) = w(^{x) where Ci^) is a fixed positive 
function and the parameter w varies from to oo. 

There is no single trajectory; each choice of the function (^{x) defines one 
possible trajectory. In a sense, the system follows many alternative paths simul- 
taneously " this is Wheeler's many-fingered time ~ and physical predictions are 
independent of the choice of the arbitrary function Ci^)- The path- independence 
is very significant because the product state Pt provides us with the only defi- 
nition of what an "instant" is, of what state p {y\x') of a distant test particle at 
x' we can agree to call simultaneous with a certain state p {y\x) of the test par- 
ticle at X. Therefore, if there is no unique sequence of intermediate states, then 
there is no unique, absolute definition of simultaneity. We see here a "foliation" 
invariance, a rudimentary form of local Lorentz invariance. 

Let t be the "time" parameter labeling successive intermediate states. The 
initial state is ■^ij{t,x) = ^ij{x), the final state is 7y (i + At, a:) — Jij{x) + 
Aj^j{x), and the intermediate states are of the form 7ij(t -I- dt,x) = Jij{x) + 
dlij{x). For appropriate choices of the shift the best-matched changes corre- 
sponding to A7jj and d'y^j are given by ea. (|14|l and 

dpi.,, = d^.,, - + Vj/?,) dt . (21) 

To determine the intermediate state Pt+dt one varies d'y^j to maximize the 
relative entropy 

S[Pt+dt\Pt] - -^dL^ = Jdxj^^^de^x) , (22) 

subject to independent constraints at each point x. For each of the factors in 
the product state Pt+dt we require that if the distance to the initial state is 
d£{x) then the distance that remains to be covered to reach the final state is 
dif{x) — Lu(x)d£{x) where 

dfix) = G^^'''df,-f,^dpj,, , (23) 

and 

di}ix) = G^^ [A^7,^. - d07,^.] [A07„ - d^7,J . (24) 
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Introducing Lagrange multipliers A(x), the basic variational principle of entropic 
dynamics is 

(>^S J dxj^/^ [df + X {d£} - uj^df)] . (25) 
Variations of dji^i give 

X(x) 

dpl^Jix) ^ xix)Ap-f^^{x) where x{x) = i ^ x{x) (1 - lu^x)) ' 

The Lagrange multipliers X{x) are determined so that the constraints d£f ^ ojdl 
hold. We get 

dl{x) = xM{x) and xi^) = ' ^^^^ 

and conclude that the selected intermediate state d^^^j is such that 

di{x)+dif{x) = Ae{x) , (28) 

which means that the metric at the point x (the metric 7) evolves along geodesies 
in its individual configuration space. Degrees of freedom at different locations 
do not, however, evolve independently of each other; they are coupled through 
the diffeomorphism constraint, ea. H19(l . which decides, at each moment in time, 
which spatial points are equilocal. Note that the trajectory described by l|28|l 
is explicitly independent of llj{x); this is foliation invariance. 

Having derived a model of statistical geometrodynamics by applying stan- 
dard rules of inference to the information codified in the states of the system, 
we can now summarize the dynamics by introducing an action that leads to the 
same equations of motion. The proposed action is 

J = f 'dt Jdxj'^^G^^'%^,,f\ (29) 

Our next step should be to explore the consequences of this statistical geometro- 
dynamics and establish the relation, if any, between this theory and Einstein's 
General Relativity, but this is a subject for future work. 



5 Conclusions and some comments 

The model of statistical geometrodynamics (SGD) developed here combines two 
basic ideas. First, the geometry of space is of statistical origin and is explained in 
terms of the distinguishability metric of Fisher and Rao. Second, the dynamics 
of this geometry is derived purely on the basis of principles of inference; there 
is no need to postulate additional "laws of nature." 

The similarities with the general theory of relativity (GR) suggest that GR 
can be obtained in some appropriate limit. For example, just as in GR the 
dynamical degrees of freedom are those that specify the conformal geometry 
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of space ■ The best- matching condition corresponds to the difFeomorphism 
constraint in the Hamiltonian formulation of GR jJHj . There is no reference to 
an external time; there is a natural intrinsic time defined by the change of the 
system itself which, just as in GR, can only be obtained after the equations 
of motion are solved Despite being derived by maximizing entropies the 

theory is time reversible. 

Perhaps the feature of SGD that does most violence to our intuition is its 
scale invariance. The scale factor a{x) needed to assign a Riemannian geometry 
to space is arbitrary and its choice should be dictated by convenience. This 
gauge invariance can be used to great advantage. The essence of the dynamics 
of GR lies in the embeddability of space in spacetime: any model that uses only 
the metric tensor to describe the changing geometry of space as it evolves in 
spacetime is equivalent to GR I conjecture that the a{x) can be chosen so 
that the evolving geometry of space sweeps out a four-dimensional spacetime 
- which amounts to choosing the gauge so that the appropriate Gauss-Codazzi 
equations are satisfied. In this particular gauge SGD should coincide with GR, 
in other words, we will have accomplished our goal of deriving macroscopic GR 
from a more basic microscopic statistical theory. 

If true, statistical geometrodynamics would have a number of implications 
for physics. Perhaps the most interesting are the revision it requires of the notion 
of distance, the statistical structure of both time and space, and the recognition 
that spacetime is not a fundamental notion. The statistical nature of geometry 
could provide mechanisms that would eliminate the infinities pervading quan- 
tum field theories, either through decoherence or through the finite number of 
distinguishable points within a finite volume. Furthermore, it would make the 
Lorentz and CPT symmetries have only statistical validity and it might bear 
on the subject of CP violation and matter-antimatter asymmetry. On the other 
hand, the scale invariance might be relevant to cosmological issues such as the 
early inflation and the late accelerated expansion of the universe. 
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